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Abstract 

Background: Whereas the most influential journals in psychiatry are English language journals, periodicals 
published in other languages serve an important purpose for local communities of clinicians and researchers. This 
study aimed at analyzing the scientific production and the recognition of non-English general psychiatry journals. 

Methods: In a cohort study, the 2009 volume often journals from Brazil (1), German language countries (5), France 
(2), Italy (1), and Poland (1) was searched for original articles. Patterns of citations to these articles during 2010 and 
201 1 as documented in Web of Science were analyzed. 

Results: The journals published 199 original articles (range: 4-46), mostly observational studies. Half of the papers 
were cited in the following two years. There were 246 citations received, or an average of 1.25 cites per article 
(range: 0.25-4.04). Many of these citations came from the local community, that is, from the same authors and 
journals. Citations by other periodicals and other authors accounted for 36% [95%-CI: 30%-42%], citations in English 
sources for 33% [28%-39%] of all quotations. There was considerable heterogeneity with regard to citations 
received among the ten journals investigated. 

Conclusion: Non-English language general psychiatry journals contribute substantially to the body of research. 
However, recognition, and in particular recognition by the international research community is moderate. 
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Background 

Over the last six decades psychiatry has undergone a 
profound shift to English as the main language of 
communication [1]. This period has witnessed switches 
to English by many important journals that originally 
had been published in other languages, for example Acta 
Psychiatrica Scandinavica or European Archives of 
Psychiatry and Clinical Neuroscience. Today, all major 
journals publish in English, and there is no non-English 
journal among the first 75 psychiatric periodicals in the 
Journal Citation Report. The situation in psychiatry only 
reflects the situation in medicine in general: the over- 
whelming majority of journals indexed in Medline are in 
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English, and at least nine out of ten newly indexed 
sources use the lingua franca [2]. 

At the same time, the number of journals publishing 
in languages other than English is rapidly increasing, 
partly due to fast growing research communities in, for 
example, Brazil, China, India, or Russia [3]. Also, doctors 
express the wish to be provided with scientific articles in 
their native language. For example, in a survey of 
German psychiatrists, about 70% considered it important 
that educational material is presented in their mother 
tongue [4]. In addition, it has been shown that doctors 
in Scandinavia remembered more after reading an article 
in their native language in comparison to the same 
material in English [5]. Therefore, journals in local 
languages serve an important purpose. 

Whereas there are no official figures regarding the num- 
ber of German language medical periodicals, the German 
central library of medicine in Cologne subscribes to no less 
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than 1200 periodicals in German. There seems to be a core 
of high level English language journals and a corona of 
many journals published in national languages [2], 

In an earlier study [6], we found that there is a lively 
scene of national language psychiatry journals in Germany: 
In 2009, there were 74 journals that addressed psychiatrists 
- solely or among other groups. Ten of those periodicals 
were general psychiatry journals that, in total, had pub- 
lished almost 400 review articles, 56 case reports but also 
almost 100 original articles. Since some of the original arti- 
cles addressed other specialties (e.g., neurologists), we 
counted 79 psychiatric original articles. The majority (72) 
were published in those five journals that were listed in 
Thomson Reuters Journal Citation Reports (that is, 
journals that had an impact factor). 

The importance of cultivating national languages has 
been emphasized [2], but it has also been argued that 
publishing original work is worthwhile only as long as it 
is in English [7]. However, there is a scarcity of data that 
may inform such debates, and the extent to which non 
English original articles are recognized in the research 
community is unknown. Citations are an accepted proxy 
for scientific recognition. Therefore, they seem to be 
ideally suited for an investigation into the recognition, 
the "impact", of scientific work. 

Accordingly, an analysis of citations to original articles 
published in ten general psychiatric journals published 
in languages other than English was carried out. Specific 
aims were to find out how many articles were cited, how 
often they were referred to and by whom. 



Methods 

This is a retrospective investigation of a cohort of ori- 
ginal articles appearing in 2009 in general psychiatric 
journals that were published in languages other than 
English. The present study builds on earlier work on 
German language psychiatry journals [6]. From this 
study all 72 psychiatric original articles in German that 
had been published in the five impact factor journals in- 
cluded were selected for citation analysis in Web of 
Science. 

As a control group a sample of general psychiatry 
journals publishing in languages other than English and 
German was selected from Science Citation Index' 
psychiatry list. Apart from language and scope (general 
psychiatry as opposed to, e.g., psychopharmacology or 
psychiatry of old age or childhood) journals were in- 
cluded when they were available in the German library 
of medicine (ZBMed, Deutsche Zentralbibliothek fur 
Medizin, Koln) or when they were freely accessible on- 
line. Table 1 documents the journals selected. The docu- 
mentation includes its publishing house, the journal's 
status regarding to Medline coverage, and both its Im- 
pact factor and Article influence score (as reported by 
JCR 2012). 

Of all periodicals so selected the complete volume of 
2009 was screened for original articles. Original articles 
published in English, as in some cases in Revista de 
Psiquiatria Clinica, were not included. An original article 
was defined as a paper presenting new research results. 
Such papers were selected regardless of the section in 



Table 1 Journals included five German language and five international non-English general psychiatry journals 
selected for citation analysis of original articles 


Journal 


Language 


Country of origin 


Publisher 


Indexed in Medline 


IF 2010 


Al 2010 


Fortschr Neurol Psychiatr 


German 


Germany 


Thieme-Verlag 


Yes 


0.652 


0.095 


Nervenarzt 


German 


Germany 


Springer-Verlag 


Yes 


0.729 


0.114 


Nervenheilkunde 


German 


Germany 


Schattauer-Verlag 


No 


0.368 


0.033 


Psychiatr Prax 


German 


Germany 


Thieme-Verlag 


Yes 


2.204 


0.110 


Z Psychiatr, Psychol Psychother 


German 


Switzerland 


Huber-Verlag 


No 


1.952 


0.163 


Ann Med Psychol 


French 


France 


Masson Editeur 


No 


0.161 


0.035 


Encephale 


French 


France 


Masson Editeur 


Yes 


0.421 


0.094 


Psychiatr Pol 


Polish 


Poland 


Wydawniczy Polskiego Torwarzystwa 


Yes 


0.173 


0.051 


Rev Psiq Clin 


Portuguese 1 


Brazil 


Sao Paulo University 


No 


0.648 


0.202 


Riv Psichiatr 


Italian 


Italy 


Pensiero Scientifico Editor 


Yes 


0.207 


0.035 



1 In 2009 Revista de Psiquiatria Clinica published a limited number of original articles in English and not in Portuguese. Those articles were not included in the 
present analysis. 

Fortschr Neurol Psychiatr, Fortschritte der Neurologie und Psychiatrie; Nervenarzt, Der Nervenarzt; Nervenheilkunde, Nervenheilkunde; Psychiatr Prax, 
Psychiatrische Praxis, Z Psychiatr, Psychol Psychother, Zeitschrift fur Psychiatrie, Psychologie und Psychotherapie. 

Ann Med Psychol, Annates Medico-Psychologiques; Encephale, L'Encephale; Psychiatr Pol, Psychiatria Polska; Rev Psyq Clin, Revista de Psiquiatria Clinica; Riv 
Psichiatr, Rivista di Psichiatria. 

IF, Impact factor; Al, Article influence score. The article influence score is different from the impact factor because it does not consider self-cites and does not rely 
on citations from journals included in Thomson Reuters' Science Citation Indices only. Similar to Google's page rank procedure citations are weighted according to 
the estimated importance of their source. The article influence score is weighted for the number of articles published in a journal (www.eigenfactor.org). Impact 
factors and article influence scores were retrieved from Thomson Reuters' Journal Citation Report. Of note, both indices take not only into account original articles 
but all citeable articles of a journal. 
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which a journal presented an article (original research, 
reviews, letter to the editors). As a consequence, but 
rarely, articles were selected even if they appeared in the 
letters to the editor section because some journals use 
this section for brief original contributions. Case reports, 
however, were not considered original articles. They 
often serve educational purposes and, in general, are not 
the result of a research project. 

Citations to original articles ("received citations") were 
included when the citing article was published in 2010 
and 2011 and citations were documented in Web of Sci- 
ence. In March and May 2012 for every original article a 
"cited reference search" was carried out in Web of 
Science. 

Every received citation was characterized with regard 
to the following criteria: year of publication of the citing 
article (2010 vs. 2011), author of citing article (self-cite 
vs. other), language of citing author (same language vs. 
English), journal of citing article (self-cite vs. other), and 
language of journal of citing article (same language vs. 
English). In order to determine the language of citing 
authors the address of the author, as presented in Web 
of Science, was used as a proxy measure. Similar to 
other studies [8] a citation received was rated as coming 
from an author of the same language when one con- 
tributor of an article's author team fulfilled the criterion. 
For example, if a French article would be cited in an- 
other article with at least one author with an address in 
France this citation would be counted as coming from 
the same language. The same definition applied to the 



status of self-citation: at least one author from the au- 
thor group of the cited paper in the byline of the citing 
paper. 

The category English includes rare cases of citations 
received in other languages: not in English and not in 
the language of the original article (those cases are indi- 
cated in Tables 2 and 3). The language status of the cit- 
ing journal was assessed as defined by Web of Science. 
In cases of doubt, PubMed, the homepage of the journal, 
or the full texts of the citing articles were used. 

Findings are presented as raw numbers, percent, confi- 
dence intervals, or ratios where appropriate. Dichotom- 
ous outcomes were compared using a x 2 -test. 

Results 

The ten journals included in this study published 199 
original articles in 2009. The dominant type of study 
was observational, often aiming at describing psycho- 
pathological, demographic and clinical characteristics of 
patients. Biological studies and randomized controlled 
trials were almost completely absent in this cohort of 
publications. In 2010 and 2011 half of all papers (n=101) 
were cited in journals included in Web of Science, with 
the total number of received cites reaching 246 (range 
1-17 cites per article). Thus, an original article was 
cited, on average, 1.25 times, 0.668 times in 2010 and 
0.588 in the 2011. 

Of the 246 received citations, 98 were from the same 
journal (40%, 95%-CI: 3496-46%). In all, two out of three 
citations received (164/246, 67%, 95%-CI: 61%-72%) 



Table 2 Cites in 2010/11 to original articles published in five German language general psychiatry journals in 2009 



Fortschr Neurol Nervenarzt Nervenheilkunde Psychiatr Z Psychiatr, Psychol Total 
Psychiatr Prax Psychother 



Original articles published in 2009 


11 


16 


13 


28 


4 


72 


Cited (in 2010+1 1) original articles 

in %, (n) 


64% (7) 


50% (8) 


31% (4) 


1 00% (28) 


100% (4) 


71% (51) 


Cites, (cites per original article) 


14 (1,27) 


18 (1,13) 


6 (0,46) 


113 (4,04) 


16(4) 


1 67 (2,32) 


. . .thereof: 














in 2010 


43% (6) 


33% (6) 


83% (5) 


65% (74) 


63% (10) 


60% (101) 


in 2011 


57% (8) 


67% (12) 


17% (1) 


35% (39) 


37% (6) 


40% (66) 


in the same journal 


27% (3) 


6% (1) 


23% (3) 


58% (66) 


19% (3) 


46% (76) 


in same language journals 


55% (6) 


17% (3) 


100% (6) 


86% (97) 


100% (16) 


77% (128) 


in English 


73% (8) 


83% (1 5) 


0% (0) 


14% (16) 2 


0% (0) 


23% (39) 


by the same authors 


71% (10) 


28% (5) 


33% (2) 


16% (18) 


81% (13) 


29% (48) 


by authors of the same language 


93% (13) 


39% (7) 


100% (6) 


95% (107) 


100% (16) 3 


89% (149) 


by other authors + journals 


27% (3) 


68% (1 2) 


33% (2) 


30% (34) 4 


19% (3) 


32% (54) 


by other authors + in English 


27% (3) 


56% (10) 


0% (0) 


11% (12) 


0% (0) 


1 5% (25) 



1 includes same journal; ^English includes two cites in non-English articles (1 in French, 1 in Italian); 3 15/16 cites are linked to the prolific editor of Z Psychiatr, 
Psychol Psychother as author of citing articles 4 If articles were taken into account that seem to have been published, at least in part, out of bibliometric interest 
or ambition [9,10] this number would shrink by 13 to 21 (reducing the rate of cites by other authors and journals to 19%). 

Fortschr Neurol Psychiatr, Fortschritte der Neurologie und Psychiatrie; Nervenarzt, Der Nervenarzt; Nervenheilkunde, Nervenheilkunde; Psychiatr Prax, 
Psychiatrische Praxis, Z Psychiatr, Psychol Psychother, Zeitschrift fur Psychiatrie, Psychologie und Psychotherapie. 
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Table 3 Cites in 2010/11 to original articles published in five international non-English general psychiatry journals in 
2009 (publishing in French, Polish, Portuguese, and Italian) 



Ann Med Psychol Encephale Psychiatr Pol Rev Psyq Clin Riv Psichiatr 



Total 



Original articles published in 2009 


46 


37 


17 


7 


20 


127 


Cited (in 2010+1 1) original articles 


30% (14) 


54% (20) 


35% (6) 


71% (5) 


25% (5) 


39% (50) 


Cites 


25 (0,54) 


35 (0,95) 


6 (0,35) 


8 (1,14) 


5 (0,25) 


79 (0,62) 


. . .thereof: 














in 2010 


48% (1 2) 


26% (9) 


33% (2) 


50% (4) 


20% (1) 


35% (28) 


in 2011 


52% (13) 


74% (26) 


68% (4) 


50% (4) 


80% (4) 


65% (51) 


in the same journal 


32% (8) 


14% (5) 


33% (2) 


25% (2) 


100% (5) 


28% (22) 


in same language journals 


60% (1 5) 


31% (11) 


33% (2) 


38% (3) 


100% (5) 


46% (36) 


in English 1 


40% (10) 


69% (24) 


68% (4) 


63% (5) 


0% (0) 


54% (43) 


by the same authors 


60% (15) 


31% (11) 


33% (2) 


38% (3) 


20% (1) 


39% (31) 


by authors of the same language 


88% (22) 


57% (20) 


50% (3) 


63% (5) 


80% (5) 


70% (55) 


by other authors + journals 


28% (7) 


60% (21) 


68% (4) 


38% (3) 


0% (0) 


44% (35) 


by other authors + in English 


20% (5) 


48% (16) 


68% (4) 


63% (3) 


0% (0) 


35% (28) 



1 English includes two cites in non-English articles (1 in Rumanian, 1 in German). 

Ann Med Psychol, Annales Medico-psychologiques (language of publication: French); Encephale, L'Encephale (French), Psychiatr Pol, Psychiatria Polska (Polish), Rev 
Psyq Clin, Revista de Psyquiatria Clinica (Portuguese; not considered were original articles in English published by Revista de Psyquiatria Clinica in 2009 and 
original articles from issue 2 in 2009 because they seem not to be covered in Web of Science; both factors render the number of original articles included small); 
Riv Psichiatr, Rivista di Psichiatria (Italian). 



appeared in periodicals publishing in the same language. 
Accordingly, 33% (82/264, 95%-CI: 28%-39%) originated 
with journals in English. 

Roughly one third of the citations received were cre- 
ated by the authors of the original articles themselves 
(79/246, 32%, 95-CI: 27%-38%). Eighty-three percent 
(204/246, 95-CI: 78%-87%) were found in articles with at 
least one author of the same language indicating that in 
17% (95-CI: 13%-22%) the original articles were referred 
to by authors or author teams of different nationality or 
language. 

Taken together, thirty-six percent (89/246, 95%-CI: 
30%-42%) of the original articles were cited by other au- 
thors as well as other journals, and about one in five 
(53/246, 22%, 95-CI: 17%-27%) of all cites to the original 
work in non-English journals came from other author 
groups that had published in English. 

The journals differed considerably with regard to all 
measures analyzed in this study. For example, the num- 
ber of original articles published in 2009 ranged from 4 
(Z Psychiatr, Psychol Psychoth) to 46 (Ann Med 
Psychol). The lowest number of cites to those papers in 
2010/11 was, at the journal level, 5 (Riv Psichiatr) 
whereas the highest number of citations received per 
journal amounted to 113 (Psychiatr Prax). The number 
of citations received per original article ranged from 0.25 
to 4.04. Similar variations can be found regarding the 
proportion of journal self-citation (range: 6-58%), the 
proportion of self-citations by the authors of the original 
article themselves (16%-81%), the percentage of citations 
that came from other authors and journals (0%-68%), 



and regarding the category of cites most distant from 
the original publication: references in English language 
journals by other authors (0-68%), with two journals 
without English citations by other authors. 

When the five national language journals from Brazil, 
France (2x), Italy, and Poland were compared to 
German language journals in a group-wise fashion no 
meaningful differences between the groups emerged, 
with three notable exceptions: Firstly, they published, as 
a group, more original articles than the German journals 
(127 vs. 72). Secondly, the number of citations received 
was higher in the group of German language psychiatric 
periodicals (167 vs. 79; cites per article: 2.32 vs. 0.62). 
Thirdly, the proportion of received citations other than 
self-citations by journals or authors is higher in the com- 
parison group (44% vs. 32%) - a result even more pro- 
nounced when only external English citations (without 
self-cites by authors) were considered: 35% vs. 15% 
(95-CI: 26%-47% vs. 10%-21%; X 2 -test: p<0.001). Still, in 
absolute numbers, an original article from German 
journals had a higher chance of being cited by other 
authors in English language journals (0.35 vs. 0.22) 
(Tables 2 and 3). 

Journals not indexed in Medline (Nervenheilkunde, 
Z Psychiatr, Psychol Psychother, Ann Med Psychol, 
Rev Psiq Clin; see Table 1) were less often cited than 
those covered in this database: 55 citations to 70 
arcticles published in the former group vs. 191 cita- 
tions to 129 original papers in the latter (0.79 vs. 
1.58 cites per article). This result did not change 
meaningfully when only citations from other authors 
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and other journals were taken into account (0.21 vs. 
0.57 cites per article). 

Discussion 

This study yielded several findings: Firstly, regardless of 
their educational focus, general psychiatry journals pub- 
lished in languages other than English contribute signifi- 
cantly to the body of research: The ten periodicals under 
study alone published 199 original articles in 2009. Sec- 
ondly, the average number of citations received in 2010 
and 2011 was 1.25. This figure decreased to 0.45 for ci- 
tations received by other authors and other journals (ex- 
ternal citations), and to 0.27 for citations received by 
other authors and in English (external international cita- 
tions). Thirdly, there are considerable differences among 
the journals included. Therefore, non-English general 
psychiatry journals do not share a distinct pattern with 
regard to the reception of their original articles. 

In an earlier study, we found that in 2009, decades 
after English became established as the universal lan- 
guage of medicine, general psychiatry journals in 
German language focused on review articles and educa- 
tional material but still published a substantial number 
of original articles [6]. The present analysis suggests that 
this applies also to the Brazilian, French, Italian, and Pol- 
ish journals included in this study. Some of the roughly 
200 original articles published in the ten periodicals 
scrutinized dealt with specifically regional topics such as 
testing of psychometric scales in the national language 
or research regarding local health service systems. And 
yet, many of the papers presented observational studies 
that were, in the reading of the author, similar to those 
appearing in many English language periodicals regard- 
ing both scope and quality. Therefore, there is no reason 
to believe that the topics in regional language psychiatric 
journals are different from English language journals. 
However, much of what by some in the field is consid- 
ered high-level psychiatric research, e.g., large scale epi- 
demiological work, biological studies, or RCTs was 
almost completely absent from this sample of non- 
English sources in 2009. 

What scientific reception does research published in 
non-English journals enjoy? Judged by citations received 
in the two years following publication, it seems that only 
a minority of articles reach a wider audience. For seven 
out of ten journals, fewer than half of all received cita- 
tions were external in the narrow definition of this 
study, that is, they came from other authors and 
journals. And in six of those periodicals the proportion 
was a third or less (total for all ten periodicals: 36% of 
citations). With regard to jumping the language barrier 
the situation is even more pronounced: Citations re- 
ceived by other authors and in English language 
journals, scientifically probably the most highly valued 



citations, accounted for only 22% of all received citations 
indicating that it is unlikely for a research paper in one 
of the languages investigated to be picked up by inter- 
national authors. The original articles from four journals 
were not cited in English sources at all. Besides propor- 
tions, absolute numbers of external (89/249) and inter- 
national external citations (53/249) for this sample of 
original articles were moderate: A virtual impact factor 
reflecting the international citations to this sample of 
original articles over the observation period 2010/11 
(without self-citations) would be 0.27 (53 cites/199 
articles). 

Limited recognition of scientific work outside the 
group of authors of the same journal may have different 
reasons. Obvious grounds include the inability of other 
scientists to read the article or the poor quality of the re- 
search. Within the sphere of a given language, however, 
it is also possible that the community of researchers and 
clinicians interested in the topic may be very small and 
well covered by the publishing journal. However, slight 
differences in scope notwithstanding, the journals in- 
cluded in this study were general psychiatry journals 
covering broad and overlapping areas of research. Still, 
for certain projects this explanation may have some 
merit, for example in health services research, a topic 
often restricted to the local health system. In addition, 
differences in the countries from which the journals ori- 
ginate cannot be dismissed: For example, the number of 
Polish psychiatry journals is smaller than that of French 
or German periodicals. 

The moderate rate of external citations to the original 
articles under study may also be an artifact of high self- 
citation rates. In general, self-citation rates are substan- 
tial, both at the level of journals (total: 40%) and authors 
(total: 32%). Of note, the differences between the 
journals included are considerable, with ranges of 6%- 
100% (journals) and 16%-81% (authors), respectively. 
However, Aksnes, studying self-citation by Norwegian 
authors on the basis of approximately 1300 papers in 
psychiatry and psychology, found an author self-citation 
rate of 21% over the whole observation period of, on 
average, 11.6 years [11]. Self-citation, however, declined 
over time indicating that a two-year self-citation rate of 
about one third is not restricted to the present set of 
journals. Studies of three top general medicine journals 
and of eight general orthopedic journals showed lower 
figures (6.5% and 1-15%, respectively [8,12]), but all of 
those journals appeared in English. 

There are many reasons to cite one's own work or the 
work that has been published in the same journal, many 
of them perfectly understandable. Often, for example, 
self-cites refer readers to important related articles, to 
sources of information presented in the text, or to pa- 
pers that are essential for understanding the historical 
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development of research projects. Other reasons include 
inflating author or journal citations as an attempt at 
improving evaluation statistics such as Impact factor or 
Hirsch-Index. Apart from obviously false citations it is 
difficult to find a universally accepted definition or even 
a numerical cut-off value for the unscientific use of self- 
cites. Eugene Garfield and Thomson Reuters as the in- 
ventor and publisher of the Impact factor have taken a 
quite liberal stance [13], but the Journal Citation Reports 
provide self-citation rates. New citation statistics such as 
the Eigenfactor, or its derivative, the Article influence 
score (Table 1) exclude self-cites. Still, there are other 
ways of artificially inflating the IF of journals, for ex- 
ample, publishing (in other periodicals) papers replete 
with references to a certain journal, with many citations 
coming from the last two years, sometimes under the 
pretext of more or less scientific questions. 

Journals from countries outside the anglophone world 
have reacted differently to the universal shift to English: 
Some, like most of those presented here, retained their 
language and are thus important sources for the regional 
community of clinicians and researchers. The quintessen- 
tial example is Annates Medico-psychologiques, founded in 
1843 and notably the oldest still running psychiatric period- 
ical in the world. 

Others have switched their publication language to 
English. Prominent examples include the European 
Archives of Psychiatry and Clinical Neuroscience (founded 
by Griesinger in 1868, and until 1983 Archiv fiir 
Psychiatrie und Nervenkrankheiten) and Acta Psychiatrica 
Scandinavica (completely in English since 1973). Today, 
they have substantially higher Impact factors (3.5 and 
4.2, resp. in Journal Citation Reports 2011) than the 
journals in our sample. It remains unclear, however, 
whether the impact of those journals on practicing and 
even on research psychiatrists is as large as the influence 
of a widely read regional journal like the Annales 
Medico-psychologiques. 

A third group of journals publishes bilingually, for 
example, Actas Espanolas de Psiquiatria or Turk 
Psikyiatri Dergisi thereby serving both the interests of 
the local audience and of the authors, but at the disad- 
vantage of high costs. A particularly striking example 
of a journal publishing in more than one language is 
World Psychiatry, the official journal of the World Psychi- 
atric Association, that appears in no less than seven lan- 
guages (Arabic, Chinese, English, French, Russian, Spanish, 
Turkish). 

Finally, some periodicals publish certain articles in 
their regional language and others in English - in our 
sample this applies to Revista de Psiquiatria Clinica 
from Brazil, and recently also to Fortschritte der 
Neurologie und Psychiatrie [14] as well as to Nervenarzt 
[15], both from Germany. 



The limitations of this study should be acknowledged: 
It has to be borne in mind that citations in journals not 
covered in Web of Science, citations in books or in doc- 
toral theses, and citations after more than two years 
were not counted. Therefore, in the strict sense, the re- 
sults presented here only refer to the observation period 
and to Web of Science. Other, more inclusive databases 
may have provided different results: It has been shown 
that Google Scholar retrieves more citations [16]. How- 
ever, this comes at the price of lower citation accuracy. 
There is also a, smaller, difference between Scopus and 
Web of Science in the number of retrieved citations. 
Web of Science, however, was chosen because it is the 
source of the Impact factor, arguably the most important 
evaluation metric in medicine. Also, Journal Citation Re- 
port Science Edition's subject category Psychiatry alone 
lists no less than 130 periodicals, not to mention the 
total of roughly 10.000 journals - quite a few in related 
subject categories - that are included in the Journal Cit- 
ation Report. Comparability to the Impact factor was 
also the motive for choosing an observation period of 
two years: For the two-year Impact factor articles pub- 
lished in 2009 were evaluated in 2010 and 2011. How- 
ever, it is likely that with a longer observation period the 
rate of self-citations would have decreased. Other im- 
portant figures, such as the rate of international external 
citations are unlikely to be affected by the observation 
period. Finally, since the journals included are a conveni- 
ence sample they are not necessarily typical for all non- 
English journals in the field. They represent, however, a 
sizable part of all local general psychiatry periodicals. 

Conclusion 

The notable differences among the journals included in 
this study preclude general statements as to a typical 
pattern of original article publication and citation. How- 
ever, even though only a limited set of psychiatric 
journals was investigated, it is fair to conclude that a 
non-negligible part of research in countries outside the 
Anglophone world is still published in languages other 
than English. During the first two years after publication, 
the reception of this scientific work, in many cases, is 
largely restricted to regional research communities, 
sometimes even to the same journal. International cita- 
tions are rare. This, however, does not mean that 
journals publishing in languages other than English do 
not serve an important purpose for their community. 
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